In the claims: 



THIS PAGE BLANKS 



015.671194.1 



1 1. (Original) In a content delivery system having m servers, S' ={S\,...,S m }, n 

2 active customers, C = {C\ 9 ... 9 C n } 9 and g geographic locations, G' ={Gi,...,G^}, wherein sdel k 

3 is a server delay of server S*, ndel jt k is a network delay observed by customers in geographic 

4 location Gj while retrieving content from server Sk 9 pj is a priority value for customer C /5 c, is 

5 a total load of customer Qi 9 My is a fraction of requests coming to customer d from region G j9 

6 fl^A is a mapping representing a fraction of requests coming to customer C, from region G, 

7 that have been redirected to server 5*, and s k represents a load capacity of server S*, a method 

8 for distributing server loads, the method comprising the steps of: 

9 representing an average prioritized observed response time as 

V H V S V m a-.xu-.x c { x p. x (sdel k + ndel . k ) 

10 AORT ~ ;and 

> c x v. 

1 1 generating a mapping that assigns requests from customers to a 

12 particular server while minimizing AORT. 
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1 2. (Original) A method as recited in claim 1, further including the step of 

2 assigning all requests from all customers in all regions to a particular server such that, for 

m 

3 each deC\ G g eG\ ^ a { jk =1.0. 
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1 3. (Original) A method as recited in claim 1, further including the step of 

2 assigning requests to a particular server while ensuring that the load capacity of each server is 

n g 

3 not exceeded such that, for each for each 4 ^ 5', ^ ^ a { jk x w /y x c i < s k . 
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1 4. (Original) A method as recited in claim 1 , further including the step of 

2 assigning requests to a particular server while balancing the load of each server to within a 

3 maximum allowed deviation from a balanced state 0 such that, for all pairs of servers, Sk and 

Z i _ 1 Z,_ 1 fl i^ x,< /J xc ' 

4 s h 1 J ~ £0+©)*— • 

n ^ g 



Z £ a 



. . , X u ■ x c 
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1 5. (Original) A method as recited in claim 4, wherein if the content delivery 

2 system should add one or more servers, or remove one or more customers, the load of each 

3 server will not be redistributed unless the maximum allowed deviation from a balanced state 

4 0 is exceeded. 

1 6. (Original) A method as recited in claim 1, further including the step of 

2 adding one or more customers to the content delivery system only if 

3 AORT new <(l + ®)xAORT old : 

4 wherein AORT Q id and AORT new are old and new values of AORT 

^ill^-tl^* = l a ^ k X UiJ * Ci X <<Sdelk + ndeljh } 

5 defined as AORT n}/i = — — 

6 and AORT new = — J - ; 

7 wherein a\ j k is a new mapping resulting from the addition of one or 

8 more customers; and 

9 wherein <t> is an allowable change in AORT for existing clients. 
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1 7. (Original) A method as recited in claim 1 , further including the step of 

2 using a linear constraint solver to generate the mapping. 
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8. (Original) A method as recited in claim 1, further including the step of 
using a non-linear constraint solver to generate the mapping. 



1 9. (Original) A method as recited in claim 1, further including the step of 

2 using a heuristic algorithm to generate the mapping, the heuristic algorithm comprising the 

3 step of assigning large a iJtk values to small u t j x c,- x (sdeh+ndelj k) values to produce a smaller 

4 overall AORT value. 
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1 10. (Original) A method as recited in claim 9, the heuristic algorithm 

2 comprising the steps of: 

3 generating a plurality of sorted lists by sorting C, values in increasing 

4 order of c/, sorting <C/,Gy> pairs in increasing order of uy 9 sorting 5* values in increasing order 

5 of sdelk, and sorting (Gj,Sk) pairs in increasing order of ndeljkl 

6 starting with a top-most, smallest value item in each list, identifying 

7 comparable smallest- value items from the other lists to generate a plurality of {C it GpSk) 

8 triples equivalent to the number of sorted lists; 

9 selecting from the plurality of (Ci,Gj,Sk) triples, the (Q,Gj,Sk) triple 

10 with the smallest uq x c, x (sdeh+ndelj^ value; 

11 assigning to a server Sk of the selected (CuGpSu) triple a remaining load 

12 from the (Ci,Gj) pair; and 

13 repeating the heuristic algorithm starting with generating the plurality 

14 of sorted lists, taking into account the changes in the values of the C, values and the (C if Gj) 

15 pairs as a result of the previous server assignment during each iteration, until the load from all 

16 (d, Gj) pairs has been assigned to a server Ski 

17 wherein if, during any iteration of the heuristic algorithm, the load 

18 capacity of the server Sk is not sufficient to handle the remaining load, the remaining load 

19 capacity of the server Sk is assigned to some of the load of the {C it Gj) pair, and an unassigned 

20 portion of the load from the <C Gj) pair is reinserted into the iterative process. 
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1 11. (Original) A method as recited in claim 10, the heuristic algorithm further 

2 including the steps of: 

3 generating a load-capacity prioritized sorted list by sorting C, values in 

4 decreasing order of remaining load capacity s^l 

5 starting with a top-most, largest value item in the load-capacity 

6 prioritized list, identifying comparable smallest-value items from the other lists to generate a 

7 load-capacity prioritized (Q, G Jr Sk) triple; 

8 considering the load-capacity prioritized {d, G Jf Sk) triple in the 

9 selection of the top-most {C if G jf S k ) triple with the smallest u u x a x (sdel k +ndel Jik ) value; and 

10 repeating the heuristic algorithm starting with generating the plurality 

11 of sorted lists, taking into account the changes in the values of the d values, the (C if Gj) pairs, 

12 and remaining load capacity as a result of the previous server assignment during each 

13 iteration, until the load from all (C it Gj) pairs has been assigned to a server 
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12. (Original) A method as recited in claim 10, the heuristic algorithm further 
including the steps of: 

generating a list of content-available (C if Sk) pairs in which the content 
of customer C,- is stored in server and 

selecting the (Ci,Gj,Sk) triple with the smallest mj x a x (sdelk+ndeljk) 
value that is also part of the list of content-available (C if Sk) pairs; 

wherein if, during any iteration of the heuristic algorithm, there is no 
{C if Gj,Sk) triple that is also part of the list of content-available (Q,Sk) pairs, a suitable 
(Ci,Gj,Sk) triple with the smallest Uijxcix(sdel k +ndelj t k) value is chosen and the data of 
customer C, is migrated to server 5*. 
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1 13. (Original) A method as recited in claim 12, the heuristic algorithm further 

2 including the step of generating a list of content-unavailable (Q,S k ) pairs in increasing order 

3 of migration time penalty for which the content of customer Q is not stored in server S k \ 

4 wherein if, during any iteration of the heuristic algorithm, there is no 

5 {C if Gj,S k ) triple that is also part of the list of content-available (C if S k ) pairs, a suitable 

6 (Ci,Gj,Sk) triple with the smallest combined u i jxc i x(sdel k +ndelj k ) value and (C it S k ) migration 

7 time penalty is chosen and the data of customer C, is migrated to server S k . 
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14. (Original) A method as recited in claim 1, further including the step of 
estimating ndeljk for non-persistent connections using HTTP logs, the step of estimating 
ndelj t k for non-persistent connections using HTTP logs comprising the steps of: 

computing an estimated round trip delay Ar jerver as t con _req_rec(i+l) - 
tres P _send_enJJ) from information stored in the HTTP logs, where t con _ req _ r ec{i+\) represents a 
time at which a connection request message is received by the server for an (z+l) th object, and 
t r esp_send_end(J) represents a time at which the server stops sending an i th object; and 

computing the response time as 

(t respond _ end - * con _r eg _rec) + 2 * , where t con ^ reg _ rec represents a time at which a 

connection request message is received by the server for an object, and t resp _ sen d_ e nd represents 
a time at which the server stops sending the object. 
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15. (Original) A method as recited in claim 1, further including the step of 
estimating ndel jik for persistent connections using HTTP logs, the step of estimating ndel jtk for 
persistent connections using HTTP logs comprising the steps of: 

computing an estimated round trip delay Ar server .client as ^con close rec 
tres P _sen<t_end(last), where t con _ close _ rec represents a time at which the server receives a request to 
close the persistent connection, and t resp _ se nd_end(^st) represents a time at which the server 
stops sending a response for a last request; and 

computing the response time as 

A y \f 

(t -t ) + server - clie "' ^r^nt h represents a connection 

V* con _ close _ rec v con _req _rec / ^ 2 cun_retj_rec r 

request time. 



1 



1 16. (Withdrawn) A method for estimating a per-byte network delay a 

2 observed by a requesting entity in a geographic location while retrieving data from a server 

3 using TCP logs, the method comprising the steps of: 

4 computing an immediate round-trip delay Ar imm between the server and 

5 the requesting entity as t con _ est - t ack send from information stored in the TCP logs, where t con _ est 

6 is a time at which a connection with the server is established, and t ac k_send is a time at which 

7 the server sends an acknowledgement to a connection request message received from the 

8 requesting entity; and 

9 determining the per-byte network delay a using the computed 

10 immediate round-trip delay Ar imm , an equation t ac k_ r eceive(k) - tdata_send(l) = Ar imm +(X x (&-/), and 

11 information stored in the TCP logs, where t dat a_send(l) is a time at which an byte of the data 

12 has been sent by the server, and t ack r eceive(k) is a time at which acknowledgement for a ^ h (k^) 

13 byte of the data is received by the server. 
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1 1 7 (Original) A method for estimating a response time observed by a 

2 requesting entity in a geographic location while retrieving objects from a server through a 

3 non-persistent connection using HTTP logs, the method comprising the steps of: 

4 computing an estimated round trip delay &r se rver,ciient as t con _ re q_rec(i+l) - 

5 t re sp_send_encii) from information stored in the HTTP logs, where t CO n_re q _rec{i+\) represents a 

6 time at which a connection request message is received by the server from the requesting 

7 entity for an (/+l) th object, and t r es P jsend_end(i) represents a time at which the server stops 

8 sending an i th object to the requesting entity; and 

9 computing the response time as 

Ar 

10 (t resp send end - t con req rec ) + 2 x se ^ client , where t con _ req _ rec represents a time at which a 

1 1 connection request message is received by the server from the requesting entity for an object, 

12 and t resp sen d_end represents a time at which the server stops sending the object to the requesting 

13 entity. 



015.671194.1 



1 18. (Original) A method for estimating a response time observed by a 

2 requesting entity in a geographic location while retrieving objects from a server through a 

3 persistent connection using HTTP logs, the method comprising the steps of: 

4 computing an estimated round trip delay £r servert c i ient as t con _ c i OS e_rec - 

5 t resp send _endilast\ where t con c iose^ec represents a time at which the server receives a request to 

6 close the persistent connection, and t reS p_send_enAlast) represents a time at which the server 

7 stops sending a response for a last request; and 

8 computing the response time as 

9 (t , - 1 ) + Arserver > client - Ar ™™^»< where t rec represents a connection 

° con close rec con req __rec f ^ 2 cun_recf_/ec r 

10 request time. 
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19. (Original) In a content delivery network having m servers, 5" = {S\ 9 ... 9 S m } , 
n active customers, C = {G,...,C rt }, and g geographic locations, G' ={Gi,...,G^} ? a content 
delivery system for distributing server loads, the content delivery system comprising: 

memory for storing a server delay sdeh of server S*, a network delay 
« delj k observed by customers in geographic location G, while retrieving content from server 
S k9 a priority value pj for customer Q 9 a total load c,- of customer Qi 9 a fraction of requests in- 
coming to customer Q from region G j5 a mapping a iJtk representing a fraction of requests 
coming to customer C, from region Gj that have been redirected to server and a load 
capacity 5a of server Sk', and 

a processor programmed for 

representing an average prioritized observed response time as 

Z ■ * i Z ■ * x Z ^ ™ t a u.* x M u x °i x ^ x ( sdel * + ) 
AORT = — , and 

generating a mapping that assigns requests from customers to a 
particular server while minimizing AORT. 
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1 20. (Original) A system as recited in claim 19, the processor farther 

2 programmed for assigning all requests from all customers in all regions to a particular server 

m 

3 such that, for each QeC\ G s eG\ ^ a i Jk =1.0. 
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1 21. (Original) A system as recited in claim 19, the processor further 

2 programmed for assigning requests to a particular server while ensuring that the load capacity 

3 of each server is not exceeded such that, for each for each e S\ 

4 Z X a u* x u u x °i - s k • 

i=l .7=1 
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1 22. (Original) A system as recited in claim 19, the processor further 

2 programmed for assigning requests to a particular server while balancing the load of each 

3 server to within a maximum allowed deviation from a balanced state 0 such that, for all pairs 

En „ g 

4 of servers, S k and S h <S (1 + 0) x . 

En „ g s t 
> a. . , x u- : x c. 

1 23. (Original) A system as recited in claim 22, wherein if the content delivery 

2 system should add one or more servers, or remove one or more customers, the processor is 

3 further programmed for not redistributing the load of each server unless the maximum 

4 allowed deviation from a balanced state 0 is exceeded. 
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24. (Original) A system as recited in claim 19, wherein the processor is 
programmed for allowing one or more customers to be added to the content delivery system 
only if AORT new < (1 + <D) x AORT old : 

wherein AORT q m and AORT new are old and new values of AORT 

S f " j Z ■ ^ ! Z ^ ! a u* x u u x °i x ( sdel * + ndel M ) 

defined as AORT,, = — — 

old ^ n 

Z ■ 2 1 2 g =l T, k m =l a 'u.k XU U X C i X ^ Sdel k + ndel iM ) 

and AORT new = — J - ; 

wherein a\ } k is a new mapping resulting from the addition of one or 

more customers; and 

wherein O is an allowable change in AORT for existing clients. 
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1 25. (Original) A system as recited in claim 19, the processor further 

2 programmed for using a linear constraint solver to generate the mapping. 



015.671194.1 



1 26. (Original) A system as recited in claim 19, the processor further 

2 programmed for using a non-linear constraint solver to generate the mapping. 
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1 27. (Original) A system as recited in claim 19, the processor further 

2 programmed for generating the mapping by assigning large a iJik values to small Uij x ci x 

3 (sdelk+ndel jt k) values to produce a smaller overall AORT value. 
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28. (Original) A system as recited in claim 27, the processor further 
programmed for: 

generating a plurality of sorted lists by sorting Q values in increasing 
order of c h sorting (C if Gj) pairs in increasing order of u ij7 sorting S k values in increasing order 
of sdel k , and sorting (G Jf Sk) pairs in increasing order of ndel jtk \ 

starting with a top-most, smallest value item in each list, identifying 
comparable smallest-value items from the other lists to generate a plurality of {C it G j} S k ) 
triples equivalent to the number of sorted lists; 

selecting from the plurality of {C u G jf S k ) triples, the (C if G Jf S k ) triple 
with the smallest mj x c,- x (sdelk+ndeljk) value; 

assigning to a server S k of the selected (C if G Jf S k ) triple a remaining load 

from the (Cj,Gj) pair; and 

repeating the heuristic algorithm starting with generating the plurality 
of sorted lists, taking into account the changes in the values of the C, values and the (C it Gj) 
pairs as a result of the previous server assignment during each iteration, until the load from all 
(C it Gj) pairs has been assigned to a server S k ; 

wherein if, during any iteration of the heuristic algorithm, the load 
capacity of the server 5* is not sufficient to handle the remaining load, the remaining load 
capacity of the server Sk is assigned to some of the load of the <Q G>> pair, and an unassigned 
portion of the load from the (C if Gj) pair is reinserted into the iterative process. 
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1 29. (Original) A system as recited in claim 28, the processor further 

2 programmed for: 

3 generating a load-capacity prioritized sorted list by sorting Q values in 

4 decreasing order of remaining load capacity s k \ 

5 starting with a top-most, largest value item in the load-capacity 

6 prioritized list, identifying comparable smallest-value items from the other lists to generate a 

7 load-capacity prioritized (G, G Jf S k ) triple; 

8 considering the load-capacity prioritized (Q, Gj t S k ) triple in the 

9 selection of the top-most {C it G jf S k ) triple with the smallest u u x d x (sdel k +ndel lk ) value; and 

10 repeating the heuristic algorithm starting with generating the plurality 

11 of sorted lists, taking into account the changes in the values of the Q values, the <Q,G y > pairs, 

12 and remaining load capacity as a result of the previous server assignment during each 

13 iteration, until the load from all (C it Gj) pairs has been assigned to a server Sk. 
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1 30. (Original) A system as recited in claim 28, the processor further 

2 programmed for: 

3 generating a list of content-available (Q,Sk) pairs in which the content 

4 of customer d is stored in server S k \ and 

5 selecting the (C» G jt S k ) triple with the smallest wj x c, x (sdel k +ndelj ik ) 

6 value that is also part of the list of content-available (C ir Sk) pairs; 

7 wherein if, during any iteration of the heuristic algorithm, there is no 

8 {Ci,Gj,S k ) triple that is also part of the list of content-available (Q,S k ) pairs, a suitable 

9 {Ci,Gj,S k ) triple with the smallest Uijxcix(sdel k +ndel jtk ) value is chosen and the data of 
10 customer Q is migrated to server S*. 
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1 31. (Original) A system as recited in claim 30, the processor farther 

2 programmed for generating a list of content-unavailable (C it S k ) pairs in increasing order of 

3 migration time penalty for which the content of customer C, is not stored in server S k ; 

4 wherein if, during any iteration of the heuristic algorithm, there is no 

5 (Ci,G Jt S k ) triple that is also part of the list of content-available (C if S k ) pairs, the processor is 

6 further programmed for selecting a suitable <C„ Gj,S k ) triple with the smallest combined 

7 Uijxcix(sdel k +ndel jik ) value and {C h S k ) migration time penalty, and migrating the data of 

8 customer Q to server S k . 
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1 32. (Original) A system as recited in claim 19, the processor further 

2 programmed for estimating ndel jtk for non-persistent connections using HTTP logs by: 

3 computing an estimated round trip delay Ar jerver c // e „ r as t CO n_req_rec(i+^) ~ 

4 tres P _send_end{i) from information stored in the HTTP logs, where t con r eq_rec{i^) represents a 

5 time at which a connection request message is received by the server for an (7+l) th object, and 

6 tres P __send_end(i) represents a time at which the server stops sending an i th object; and 

7 computing the response time as 

8 (t resp send end - t con req rec ) + 2 x Ar -™^»< 9 where t con _ req _ rec represents a time at which a 

9 connection request message is received by the server for an object, and t resp _ sen d_end represents 
10 a time at which the server stops sending the object. 
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1 33. (Original) A system as recited in claim 19, the processor further 

2 programmed for estimating n del jt k for persistent connections using HTTP logs by: 

3 computing an estimated round trip delay Ar serv er,ciient as 

tcon close rec 

4 t re sp_send_end(lasi)-> where t con _ciose_rec represents a time at which the server receives a request to 

5 close the persistent connection, and t reS p_send_end(lasi) represents a time at which the server 

6 stops sending a response for a last request; and 

7 computing the response time as 

a {t concloserec -t con _ rev _ re J + Arse ™' c ' ien ' - ^Y'*"' ' where re P resents a connection 

9 request time. 
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